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VOLUME  1 

FLEET  RELIABILITY  ASSESSMENT  PROGRAM 
GENERAL  PROGRAM  REPORT 


SECTION  I.  INTRODUCTION 
1-1  BACKGROUND 


1-1.1  The  Chief  of  Nival  Material  (CMN)  Indicated  through  NAVMAT-06  that  the 
number  one  priority  In  the  reliability  area  Is  the  development  of  a reliability 
reporting  and  tracking  system  for  operational  equipment.  This  system  must  be  sult- 
able  for  rapid  response  to  reliability  problems  so  that  corrective  actions  can  be 
,ted  as  early  as  P°sslble.  The  CNM  requirements  are  documented  In  NAVMATINST 
3000.1  and  CNM  memo  (ADM  I.C.  Kidd)  of  10  April  1974. 

llI;?rwl!I.^ponse  t0  th1s  Pr1ority  requirement,  with  CNM  approval  and  CNO  concurrence, 
NAVELEXSYSCOM  Initiated  the  Fleet  Reliability  Assessment  Program  (FRAP)  as  a pilot 
study  of  electronics  equipment  newly  Introduced  Into  the  fleet. 

1-2  PURPOSE 


1-2.1  The  purpose  of  FRAP  was  to  test  the  feasibility  of  reducing  life  cycle  costs 
and  Improving  fleet  readiness  through  an  organized  program  of  controlled  observations 
of  samples  of  newly  deployed  operational  systems  followed  by  early  reliability 
Improvements  based  on  these  observations.  A rapid  response  Is  assured  by  FRAP  through 
a closely  coordinated  effort  Involving  the  operational  fleet,  naval  and  contractor 
facilities,  and  equipment  support  activities  Illustrated  in  Figure  1-1.1.  Problem 
areas  and  failure  mechanisms  are  Identified,  and  corrective  actldns  recommended  to 
the  cognizant  equipment  manager. 

1-2.2  GOALS.  The  primary  goals  of  the  FRAP  are  the  following: 

(1)  Improve  Operational  Availability 

(2)  Reduce  Life  Cycle  Cost 

1-2.3  OBJECTIVES.  In  support  of  the  FRAP  goals  the  following  objectives  were 
established. 

(1)  Measure  the  Reliability  ^ of  electronics  equipment  early  In  fleet  operation. 

(2)  Identify  equipment  deficiencies  and  take  (recomnend)  corrective  action 
promptly. 

(3)  Improve  logistics  support  effectiveness. 

(4)  Recommend  Improvements  to  3M  MDS. 


(1)  Both  Operational  Reliability  and  Equipment  Reliability.  See  glossary  for 
definitions  of  these  terms. 
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1-3  SCOPE. 


1-3.1  EQUIPMENT.  The  equipment  Included  In  the  pilot  FRAP  effort  were  the  follow- 
ing: 

(1)  AN/SSR-1  Satellite  Communl cations  Receiver 

(2)  AN/WSC-3  Satellite  Communications  Set 

(3)  AN/URC-85  UHF  Communications  Set 

(A)  AN/URC-62  (VERDIN)  VLF  Comnunl cations  System 
(5)  AN/UYK-20  Data  Processing  Set  (Mini -computer) 

1-3.2  PLATFORMS.  The  sample  platforms  that  participated  In  the  pilot  FRAP  are 


summarized  by  platform  type  and  fleet  below: 

PLATFORM  ATLANTIC  PACIFIC 

FLEET 

TYPE 

FLEET 

FLEET 

TOTAL 

Carrier 

3 

3 

6 

Cruiser 

3 

1 

4 

Destroyer 

6 

4 

10 

Frigate 

5 

1 

6 

Auxiliary 

4 

3 

7 

Landing  Ship 

5 

2 

7 

Submarine 

9 

6 

15 

TOTAL 

35 

20 

55 

A more  complete  Identification  of  platforms  Is  presented  In  Table  1-1.1 
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PLATFORM 

HULL 

NAME  • 

NO. 

Adams,  Charles  E. 

DDG-2 

Albany 

CG-10 

Batflsh 

SSN-681 

Brown,  Jesse  L. 

FF-1089 

Capadannc 

FF-1093 

Coronado 

LPD-11 

Daniels,  Josephus 

CG-27 

Davis 

DD-937 

Dupont 

DD-941 

Farragut 

DDG-37 

Finback 

SSN-670 

Forrestal 

CV-59 

Flying  Fish 

SSN-673 

Purer,  Julius  A. 

FFG-6 

Guadalcanal 

LPH-7 

Guam 

LPH-9 

Holland 

AS-32 

Hunley 

AS-31 

Ingram,  Jonas 

DD-938 

Kamehameha 

SSBN-642 

Kennedy,  John  F. 

CV-67 

Key,  Francis  Scott 

SSBN-657 

Lafayette 

SSBN-616 

Lake,  Simon 

AS-33 

MacDonough 

DDG-39 

Madison,  James 

SSBN-627 

Milwaukee 

AOR-2 

Manitowoc 

LST-1180 

Narwhal 

SSN-671 

Nlml tz 

CV-68 

Page,  Richard  L. 

FFG-5 

Sea  Devil 

SSN-664 

Valdez 

FF-1096 

Walnwrlght 

CG-28 

Whitney,  Mount 

LCC-20 

SHIP  TYPE 

Guided  Missile  Destroyer 
Guided  Missile  Cruiser 
Nuclear  Sub 
Fast  Frigate  , 

Fast  Frigate 

Amphibious  Dock  Transport 
Guided  Missile  Cruiser 
Destroyer 
Destroyer 

Guided  Missile  Destoryer 
Nuclear  Sub 
Aircraft  Carrier 
Nuclear  Sub 

Guided  Missile  Frigate 
Amphibious  Assault  Ship 
Amphibious  Assault  Ship 
Submarine  Tender 
Submarine  Tender 
Destroyer 

Nuclear  Ballistic  Missile  Sub 

Aircraft  Carrier 

Nuclear  Ballistic  Missile  Sub 

Nuclear  Ballistic  Missile  Sub 

Submarine  Tender 

Guided  Missile  Destroyer 

Nuclear  Ballistic  Missile  Sub 

Replenishment  Oiler 

Tank  Landing  Ship 

Nuclear  Sub 

Aircraft  Carrier 

Guided  Missile  Frigate 

Nuclear  Sub 

Fast  Frigate 

Guided  Missile  Cruiser 

Amphibious  Command  Ship 


TABLE  1-1.1 A FRAP  SAMPLE  PLATFORMS  (ATLANTIC) 


PLATFORM 

HULL 

NAME 

NO. 

Abraham  Lincoln 

SSBN-602 

Constellation 

CVA-64 

Coral  Sea 

CVA-43 

Enterprise 

CVN-65 

Ethan  Allen 

SSBN-608 

Hawkblll 

SSN-666 

Hoel 

DDG-13 

Jouett 

CG-29 

Kansas  City 

AOR-3 

Monti cello 

LSD-35 

Morton 

DD-948 

Proteus 

AS-19 

Plunger 

SSN-595 

Puffer 

SSN-652 

Sam  Houston 

SSBN-609 

San  Bernardino 

LST-1189 

Somers 

DDG-34 

Waddell 

DDG-24 

Whl pple 

FF-1062 

Wichita 

AOR-1 

SHIP  TYPE 

Nuclear  Ballistic  Missile  Sub 
Aircraft  Carrier 
Aircraft  Carrier 
Nuclear  Aircraft  Carrier 
Nuclear  Ballistic  Missile  Sub 
Nuclear  Sub 

Guided  Missile  Destroyer 
Guided  Missile  Cruiser 
Replenishment  Oiler 
Dock  Landing  Ship 
Destroyer 
Submarine  Tender 
Nuclear  Sub 
Nuclear  Sub 

Nuclear  Ballistic  Missile  Sub 
Tank  Loading  Ship 
Guided  Missile  Destroyer 
Guided  Missile  Destroyer 
Fast  Frigate 
Replenishment  Oiler 


TABLE  1-1. B FRAP  SAMPLE  PLATFORMS  (PACIFIC) 
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SECTION  II.  MANAGEMENT  CONCEPT 


2-1  ORGANIZATION.  FRAP  functions  through  an  organizational  structure  consisting 
of  a sponsor.  Lead  Field  Activity  (LFA),  Technical  Support  Activities  (TSA),  equip- 
ment manufacturers,  and  participating  fleet  personnel  as  Illustrated  In  Figure 

1- 2.1.  The  Naval  Electronics  System  Command  (NAVELEX  470)  sponsers  FRAP,  provides 
general  direction  and  guidelines  to  the  LFA,  and  Interfaces  with  cognizant  NAVELEX 
equipment  managers  and  higher-level  Navy  management.  The  Naval  Weapons  Support  Cen- 
ter (NAVWPNSUPPCEN)  Crane  Is  the  LFA  responsible  to  NAVELEX  470  for  the  management 
of  FRAP. 

2- 2  LEAD  FIELD  ACTIVITY.  The  LFA's  responsibilities  Include: 

(1)  Program  management  and  technical  direction. 

(2)  Equipment  functional  modeling. 

(3)  Statistical  sampling  plans. 

(4)  Functional  data  requirements  for  equipment. 

(5)  Engineering  R/M/A  (Reliability,  Maintainability,  and  Availability)  assess- 
ment of  equipment  performances. 

(6)  Failure  modes  diagnosis  and  effects  analysis. 

(7)  Corrective  action  proposals  (ECP's,  training,  etc.). 

2-3  TECHNICAL  SUPPORT  ACTIVITIES.  The  TSAs  are  responsible  for  the  collection 
of  failed  "throwaway"  items  from  organizational-level  maintenance  activities  and 
for  obtaining  fleet  prepared  maintenance  forms.  The  maintenance  forms  are  monitored 
for  completeness  and  adequacy;  deficiencies  are  noted  and  appropriate  action  taken 
for  correction.  The  TSAs  also  Interface  with  equipment  manufacturers,  field  mainten- 
ance activities,  and  depots  In  acquiring  failure  analysis  and  reliability  data  on 
failed  repairable  Items  forwarded  to  them  by  the  fleet.  In  addition,  the  TSA  performs 
failure  analysis  on  the  returned  throwaways  and  reports  findings  to  the  LFA. 

2-4  PLANNING  AND  CONTROL.  Formal  program  planning  was  accomplished  and  Implemented 
by  means  of  LFA  and  TSA  Implementation  Plans.  The  Implementation  Plans  provided 
for  detailed  planning  and  scheduling  of  the  several  phases  of  the  program  that  were 
necessary  to  coordinate  the  efforts  of  the  field  activities  Involved.  The  Imple- 
mentation Plans  also  established  the  requirements  for  other  planning  documents,  such 
as  Sampling  Plan,  Data  Collection  Plan,  and  Report  Publication.  Program  control 
wes  accomplished  through  monthly  status  letter  reports  and  quarterly  program  review 
meetings. 
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SECTION  III.  TECHNICAL  APPROACH 


3-1  The  approach  toward  accomplishing  the  objectives  of  FRAP  Is  an  early  Identi- 
fication of  maintenance  problems  encountered  with  electronic  equipment  operating 
In  the  fleet  environment  followed  by  an  Intensive  reliability  Improvement  program. 
Selected  samples  of  each  pilot  FRAP  equipment  were  closely  monitored  over  a nine- 
months  period  of  fleet  operation.  Fifty-five  representative  platforms  were  chosen 
as  sources  of  organizational -level  Information.  This  data  along  with  Intermediate 
and  depot-level  repair  records  Is  used  to  determine  achieved  operational  and  equip- 
ment reliability  and  to  Identify  significant  problems. 

3-2  Major  elements  of  this  approach  Include  developing  equipment  reliability  models, 
choosing  a representative  sample  from  the  total  equipment  population,  collecting 
data  from  organizational  and  depot  maintenance  levels,  performing  fault  Isolation 
and  failure  analysis,  analyzing  the  data  In  order  to  assess  Its  significance.  Identi- 
fying corrective  action,  and  recommending  for  Implementation  that  action  proven  to  be 
most  cost  effective  from  a life  cycle  point  of  view.  In  order  to  cost  effectively 
accomplish  these  tasks,  FRAP  makes  extensive  use  of  facilities  and  data  collection 
resources  already  established. 

3-3  SAMPLING  PLAN. 

— 

3-3.1  The  prerequisites  for  developing  the  pilot  FRAP  sampling  plan  were: 

(1)  The  parameter  of  prime  Importance  Is  the  Mean-TIme-Between-Fal lures. 

(2)  FRAP  parameter  evaluations  be  no  more  discriminating  than  the  procurement 
test  programs. 

(3)  Confidence  level  of  90%  be  used. 

(4)  Desire  to  determine  appropriate  reliability  probability  distribution. 

(5)  Environments  are  Important. 

(6)  The  sample  be  representative  of  the  existing  population. 

3-3.2  The  sampling  plan  was  developed  using  the  above  factors  as  described  below.  The 
total  population  sub-divided  by  platform  types  was  obtained  for  each  equipment.  The 
platform  types  were  then  ranked  for  each  of  the  equipments  In  decendlng  order  of 
equipment  population.  Since  environments  were  Important,  It  was  desired  to  utilize  at 
least  the  two  highest  ranking  types  of  platforms  for  each  FRAP  equipment  and  to  have 
samples  of  each  platform  type  from  both  the  Atlantic  and  the  Pacific  Fleet.  This  also 
gave  sample  representation  of  platforms  with  the  most  equipments.  Then,  to  obtain 
a measure  of  replication  within  an  expected  similar  environment,  at  least  two  plat- 
forms of  each  type  from  the  same  fleet  were  desired.  Further,  to  determine  If  different 
types  of  platforms  and/or  Fleets  produce  significantly  different  results  at  least  four 
failure  events  were  desired  from  the  expected  similar  environments. 

3-3.3  In  order  to  determine  the  appropriate  reliability  probability  distribution 
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and  to  determine  If  • failure  mod*  Is  predominant  It  ms  desirable  to  accumulate 
approximately  20  failures  during  the  planned  six-months  data  collection  period. 

3-3.4  Procurement  risks  (producer's  and  consumer's)  Mre  obtained  from  the 
MIL-STD-781  Test  Plans  when  the  plans  Mre  specified  In  contract  documentation. 

Since  the  probability  of  accepting  the  minimum  acceptable  MTBF  (0, ) Is  different 
for  different  Test  Plans,  the  respective  operating  characteristic  curves  Mre 
used  to  choose  a MTBF  for  each  equipment  which  would  have  a 90S  probability  of  accep- 
tance. Thus  to  obtain  similar  discrimination  In  FRAP,  the  loMr  90S  confidence  limit 
for  FRAP  should  be  In  the  neighborhood  of  this  value. 

3-3.5  To  compare  the  operational  MTBF  and  the  procurement  MTBF  at  the  expected 
similar  operational  environment,  confidence  limits  Mre  constructed  for  these 
environments  beginning  with  two  platforms  per  environment.  The  following  assumptions 
Mre  used  to  calculate  the  confidence  limits: 

(1)  Reliability  follows  the  exponential  distribution. 

(2)  A six-months  data  collection  period  with  a one-third  duty  cycle. 

(3)  The  specified  MTBF  (0o)  exists  In  the  Fleet. 

With  these  assumptions,  the  following  formula  ms  used  to  obtain  expected  one- 
sided 901  confidence  limits  and  expected  80*  confidence  Intervals, 

2T  ^ 0 $ 21 

X20.90,  2r+2  X20.10,2r 

where 

T ■ equipment  operating  time 

* (6  mo  x 720  hrs/mo  x 1/3  x N) 

* 1440  hr  x N 

r ■ No.  of  failures  expected 

* <T/0o) 

X2  ■ Chi-square  value  at  Indicated  percentile  and  degrees  of  freedom 
N ■ Sample  size 

The  desired  sample  size  ms  determined  as  the  loMst  value  of  N which  would 
give:  (1)  a loMr  limit  at  least  as  great  as  the  MTBF  having  a 90*  probability  of 
acceptance;  and,  (2)  meeting  the  other  criteria  enumerated  above.  Platforms  Mre 
then  selected  at  random  from  those  not  having  planned  overhaul  or  restricted  avail- 
ability during  the  planned  data  collection  period. 

3-3.6  Sample  sizes  and/or  platforms  were  modified  as  required  due  to  platform  un- 
availability as  determined  by  type  and  group  Commanders.  Also,  the  six-months  data 
collection  period  ms  Increased  to  nine-months  primarily  due  to  early  duty  cycles 
being  much  less  than  one-third. 
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3-4  EQUIPMENT  RELIABILITY 


f 


r 


MODEL. 


3-4.1  Maintenance  of  Naval  shipboard  equipment  Is  accomplished  by  replacement  or 
repair  of  components  at  Organizational  (0),  Intermediate  (I),  or  Depot  (0)  repair 
levels.  Ships  Maintenance  and  Material  Management  (3-M)  routinely  collects  organ- 
izational level  repair  data  but  not  Intermediate  or  depot  level  repair  data.  Using 
3-M  field  data  requires  that  the  lowest  components  of  the  model  be  the  lowest  level 
reported  by  3-M,  the  0-level  replaceable  component.  This  0-level  component  can  be 
a piece  part,  printed  circuit  board,  major  assembly,  or  whatever  Is  planned  In  the 
0-level  maintenance  concept. 

3-4.2  Although  FRAP  equipments  may  have  more  than  one  mode  of  operation,  typically 
all  modules  are  completely  energized  whenever  the  equipment  is  turned  on.  Therefore, 
a serial  model  Is  both  convenient  and  realistic  for  most  of  the  pilot  FRAP  equipments. 

3-4.3  The  reliability  models  are  used  to  determine  the  achieved  operational 
reliability  and  also  to  assess  the  effect  of  ECPs  and  other  corrective  action  upon 
system  reliability.  Maintenance  Action  Reports  are  compared  against  the  model  to 
determine  whether  or  not  a reported  component  failure  results  In  a system  failure,  a 
degradation  of  system  performance,  or  has  no  effect  on  the  system  capability.  The  mo- 
dels are  also  used  In  determining  logistics  support  requirements. 

3-5  DATA  COLLECTION. 

3-5.1  Each  of  the  FRAP  pilot  equipments  has  two  planned  levels  of  maintenance— organi- 
zational and  depot.  At  the  organizational  level  either  chassis-mounted  components 
or  electronic  modules  are  replaced  to  complete  the  repair.  The  chassis-mounted 
components  are  typically  considered  throwaway  Items;  but,  repairable  electronic 
modules  are  returned  to  the  depot  for  component  repair  or  replacement.  Repair  records 
of  organizational  and  depot-level  maintenance  constitute  the  basis  for  reliability 
and  maintainability  analysis.  Organization- level  repair  and  maintenance  data  for  the 
selected  sample  of  equipment  were  received  from  the  fleet  by  direct  mall  using  FRAP 
provided  mailing  envelopes.  Depot  repair  records  were  obtained  on  the  total  equipment 
population.  Besides  determining  equipment  reliability,  FRAP  has  secondary  objectives 
which  Include:  (1)  evaluating  equipment  maintenance— especially  the  reliability  of 
software  diagnostics  and  built-in-test;  (2)  verifying  some  of  the  basic  assumptions 
used  In  the  reliability  model— especially  the  failure  rate  distribution  and  component 
MTBF  predictions;  (3)  developing  a maintenance  model;  and,  (4)  describing  the  field 
environment.  These  secondary  objectives  require  Information  not  generally  collected 
by  3-M.  Therefore,  a rapid  means  to  provide  additional  data  beyond  normal  maintenance 
data  had  to  be  Identified.  Necessary  additional  data  Included  time  meter  readings 
at  time  of  problem  discovery  and  completed  maintenance,  descriptions  of  diagnostic 
procedure  used  to  Isolate  malfunctions,  and  environmental  Information. 

3-5.2  FRAP  was  coordinated  very  early  with  both  Atlantic  and  Pacific  Fleet  operational 
units  and  NAVMAT  to  determine  a suitable  way  of  obtaining  the  desired  data  that 
would  be  both  timely  and  consistent  with  present  3-M  operating  procedure  without 
creating  an  excessive  burden  on  naval  personnel. 
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3-5.3  The  procedure  that  was  adopted  and  approved  by  CNN  Is  simply  to  report  the 
additional  data  Items  In  Block  35  of  the  standard  OPNAV  4790/2K  Ships'  Maintenance 
Action  Form,  Figure  1-3.1.  A copy  of  completed  forms  Is  sent  by  the  organizational - 
level  maintenance  activity  to  a designated  FRAP  point  of  contact.  In  addition, 
a completed  copy  of  maintenance  form  should  be  attached  to  each  repairable  Item  sent 
to  the  depot.  A reference  Job  Control  Number  on  the  forms  allows  the  part  and  main- 
tenance actions  at  the  0-and  D-level  to  be  correlated.  Visits  by  FRAP  team  members 
to  the  Individual  platforms  for  Initial  data  collection  briefings  facilitated  the 
collection  of  the  required  data.  For  the  one  air  cog  equipment,  the  AN/ART-50, 
Maintenance  Action  Forms  (NAF's),  OPNAV  4790/60,  were  obtained  during  visits. 

3-5.4  At  the  start  of  the  data  collection  period,  equipment  serial  numbers  and  time 
meter  readings  were  recorded  to  Initialize  data  records.  These  recordings  were 
taken  during  a visit  to  the  selected  platforms  for  the  purpose  of  providing  briefings 
and  training  material.  At  the  end  of  the  data  collection  period,  visits  were  made  to 
record  final  serial  numbers  and  time  meter  readings.  Also,  during  the  data  collection 
period  monthly  feedback  reports  were  sent  to  the  participating  platforms. 

3-5.5  The  depot  repair  facility  receives  repalrkble  units  from  the  total  population 
of  each  FRAP  equipment.  Each  month,  the  LFA  receives  repair  action  summaries  from 
the  depot  covering  the  entire  equipment  population.  These  summaries  are  used  to 
determine  which  maintenance  actions  Initiated  by  the  organizational  level  resulted 
In  repair  actions  at  the  depot.  Such  failure  tracking  Is  necessary  to  calculate 
equipment  reliability.  Failure  analysis  on  parts  removed  at  the  depot  Is  performed 
either  by  the  depot,  LFA,  or  TSA.  See  Figure  1-3.2  for  an  Illustration  of  the  Fleet 
FRAP  Interface. 

3-6  DATA  ANALYSES. 

3-6.1  The  major  purposes  of  the  data  analyses  are  to  determine  the  operational  rel- 
iability or  dependability  of  the  selected  equipment;  assist  In  proposing  and  Imple- 
menting cost-effective  corrective  action  within  contractors'  warranty  periods;  and, 
assist  In  presenting  methods  of  Improving  the  operational  reliability  of  new  electronics 
equipment.  The  basic  source  of  FRAP  operational  reliability  data  Is  the  additional 
data  requested  for  FRAP  and  entered  Into  Block  35  of  the  3-M  OPNAV  4790/ 2K  or  OPNAV 
4790/60  forms  for  the  sample  FRAP  equipments.  The  additional  data  requested  Included 
specific  time  meter  readings  and  environmental  assessment  both  upon  observation 
and  correction  of  a failure.  Other  additional  Items  requested  were  diagnostic 
procedure  used  and  more  complete  corrective  action  description. 

3-6.2  Maintenance  Information  Is  obtained  directly  from  the  data  normally  recorded 
on  3-M  forms.  For  example.  Active  Maintenance  Times  (Block  32  of  2K  form)  Is  the  Time 
to  Repair  (TTR)  In  hours;  and.  Date  Completed  (Block  31)  minus  Date  Discovered 
(Block  17)  gives  downtime  In  days.  Maintenance  actions  are  uniquely  Identified  by 
Job  Control  Numbers  (JCN),  thus,  allowing  traceability  of  failures  from  reporting 
units  to  repair  depots  whenever  a copy  of  the  2K  form  accompanies  the  failed  part. 

3-M  forms  also  contain  data  further  Identifying  the  equipment  on  which  failures 
were  observed.  The  Depot  Monthly  Repair  Summaries  list  the  failed  parts  received  from 
the  fleet  and  results  of  failure  analyses.  Therefore,  when  the  JCN  Is  given  for 
each  part  returned,  the  failures  are  uniquely  Identified. 
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3-6.3  The  statistical  distribution  of  tht  time  to  failure  and  other  reliability 
parameters  are  determined  from  the  data  collected  for  each  FRAP  equipment.  Statistical 
methods  such  as  non-pa rametrlc  distributions . distribution  plots,  goodness -of -fit 
tests,  confidence  Intervals,  computer  simulation,  and  other  suitable  techniques  are 
used.  These  metlcc*  are  described  In  Appendix  D.  The  reliability  model  Is  updated 
as  dictated  by  such  analyses.  The  updated  reliability  model  Is  exercised  using  fleet 
operational  data;  and,  the  results  compared  with  specification  values.  The  model 
is  also  used  to  assess  the  significance  of  other  variables  such  as  proposed  engineer- 
ing changes  and  logistics  support.  Discrepancies  noted  between  specified  reliabili- 
ties and  measured  or  predicted  reliability  values  are  analyzed  to  Identify  problem 
areas  and  evaluate  whether  the  complexity  of  reliability  models  are  adequate  or  need 
modifying  to  account  for  discrepancies. 


*mm  in*  t-m 


SECTION  I 

IDENTIFICATION 


SHirS  MAINTENANCE  ACTION  HMM(2-«L0| 


JOE  CONTNOL  numeem 


I % 


Hi  iOONlKM  f Co 


L-umm'ni 


FOR  SELECTED  EQUIPMENTS  ONLY 


T.  I.  M.  E 


,1  , N,  6,  ,(  ,E  , T,  H,  , I.  0,  E,  N,  T,  I,  F,  I,  C,  A 


L • 0.  C.  A.  T.  1.  0i  Ni) 


i i Ei  Qi  U«  It  P,  M,  E.  Nt  T.  iE  iN  .V  ■!  .R  <0  iN  <M  ,E  iN  tT  i i i i i i i 


i T|  H.  E,  R,  , C.  L>  A.  Ri  I.  Ft  Y|  !■  Nt  Gt  • R,  Ei  Mi  Ai  Ri  Ki  Si  i i i 


T |I  |M  tE  |S  > i 0t  Ff  f Cf  Of  Mf  P(  Li  Ef  Ti  It  0i  Ni  &> 


Ei  Tf  Mi  ■ Ri  E|  At  0.  Ii  Ni  Gi  i (■  Ei  Ti  Mi  ■!  iD  iE  iN  iT  il  iF  il  iC  iA  i- 


Tf  Ii  Of  Ni  i iL  i0  iC  iA  iT  il  i0  iN 


I I T|  Ii  Vi  Ei  I Ai  C,  Ti  Ii  Ol  Ni  I & I I D|  Il  Ai  G 


0|  Ti  H,  Ei  Ri  i Ri  E)  Mi  Ai  Ri  Ki  S 


t CON»CMMl<l>.  WAN  (FHMJ 


ir^rTnCT.TMi:rr.mr.fiPipi 


TIM  NCI  ACTiON/NIMANM 


) ) ) 1 I I 


FIGURE  I -3.1  OPNAV  4790/2K  FORM 


*U.t.  aOVKRNMCMT  WWMTIN®  OFFICtt  1ST4  “71*  - 10* 


fiCOBACK  *e/>OKT 

(monthly) 


\ 


SECTION  IV  - RESULTS 
4-1  PROGRAM  RESULTS 

4-1.1  OBJECTIVES  ACHIEVED.  FRAP  achieved  Its  objectives.  The  planned  management  con- 
cept was  successfully  Implemented,  and  the  LFA/TSA  organization  provided  the  required 
support  to  NAVELEX  despite  a SYSCOM-wlde  funding  crunch  in  the  second  and  third  quarters 
of  FY  77.  In  NAVELEX  headquarters  a liaison  billet  was  established  that  greatly  faci- 
litated coordination  and  communl cation  between  headquarters  and  field  activities. 

4-1.2  RELIABILITY  MEASUREMENT.  The  fleet  data  collection  program  was  successfuly  Im- 
plemented. A computer  program  was  developed  to  facilitate  analysis  of  the  data  received 
from  the  fleet.  A number  of  visits  were  made  to  platforms  at  Guam,  Pearl  Harbor,  Subic 
Bay,  San  Diego,  San  Francisco,  New  London,  Norfolk,  Charleston,  Mayport,  Holy  Loch,  and 
Rota.  Information  obtained  from  4790/2K  failure  reports,  ships'  logs,  and  direct  con- 
tact were  analyzed  by  computer  to  obtain  probability  distributions  for  operational  reli- 
ability, repair  time,  and  down  time,  as  well  as  mean  value  and  median  value  estimators 
for  reliability,  repair  time,  down  time.  Inherent  availability,  and  operational  avail- 
ability. In  addition  to  the  above  analysis  conducted  at  the  system  level,  analysis 
and  printouts  were  obtained  for  WRA  and  0-level  component  levels  of  assembly.  Refer 
to  Section  IX  of  the  Equipment  Reports  for  examples  of  these  analyses.  Analysis  of 
data  obtained  from  Depot  Repair  Facilities  enabled  operational  reliability  parameters 
to  be  converted  to  equipment  reliability  parameters.  Numerical  results  are  summarized 
In  Section  4-2. 

4-1.3  PROBLEM  DETECTION.  Both  the  analysis  of  depot  data  and  the  analysis  of  fleet 
data  enable  the  detection  and  Isolation  of  hardware  problems.  The  FRAP  developed  struc- 
tured analysis  technique  Indicates  the  relative  Importance  of  module-level  problems 
with  respect  to  one  another.  The  analysis  of  fleet  data  indicates  the  severity  of  the 
problem  with  respect  to  specification  values  or  operational  criteria,  such  as  avalla- 
bllty.  In  addition  to  these  two  formalized  methods  of  problem  detection  and  Isolation, 
the  open  communication  between  FRAP  and  the  fleet  and  between  FRAP  and  Depot  Repair 
Facilities  has  resulted  In  the  detection  and  identification  of  problems  other  than 
catastrophic  hardware  failures.  Specific  Instances  are  discussed  In  the  Equipment 
Reports. 

4-1.4  LOGISTICS.  The  collection  and  analysis  of  real  time  RMA  performance  data  has 
led  to  a better  understanding  of  the  mutual  Influence  of  reliability,  maintainability, 
and  logistics  In  the  attainment  of  necessary  operational  availability  and  readiness  In 
the  fleet.  The  FRAP  developed  logistics  model  (Appendix  E)  permits  a better  understand- 
ing of  the  current  Fleet  Logistics  Support  Improvement  Program  (FLSIP)  and  the  effect 
of  Best  Replacement  Factor  (BRF)  calculations  upon  operational  availability.  Specifical- 
ly, It  has  been  shown  that  FLSIP  leads  to  a minimum-element  allowance  parts  list  (APL) 
rather  than  a minimum-cost  APL.  Results  obtained  from  the  FRAP  logistics  model  using 
actual  reliability  data  for  the  AN/WSC-3  Communications  Set  has  led  to  a significant 
Increase  In  the  APL  for  the  AN/WSC-3  and  has  provided  the  solid  Information  needed  for 
realistic  logistics  planning  and  decision  making. 

4-1.5  FLEET  RECEPTION.  FRAP  has  received  the  enthusiastic  support  of,  and  cooperation 
from,  shipboard  personnel  on  all  the  platforms  visited.  Shipboard  personnel  are  vitally 
concerned  with  the  reliable  operation,  the  maintainability,  and  the  logistics  support 
(spares  availability)  of  their  equipment.  The  person-to-person  contact  between  the 
fleet  and  the  FRAP  team  has  been  highly  beneficial  because  of  the  willingness  and  the 
ability  of  the  men  aboard  the  ships  to  discuss  and  analyze  their  equipment  problems. 
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One  example  of  the  extra  effort  extended  by  the  fleet  is  the  fault  location/failure 
analysis  packet  received  from  the  submarine  tender  USS  SIMON  LAKE,  AS-33,  dealing 
with  a failure  of  the  AN/WRR-7  VERDIN  receiver.  Figure  1-4.1  Is  a partial  reproduc- 
tion of  six  photographs  Indicating  the  results  of  an  overheating  voltage  regulator 
microcircuit.  The  original  photographs  are  of  excellent  quality  and  clearly  show  the 
blackened  case,  and  the  melted  solder  on  the  reverse  side  of  the  printed  circuit 
board.  Another  example  of  the  fleet's  concern  Is  the  4-page  commentary  on  AN/UYK-20 
overheating  problems  submitted  by  the  USS  GUAM,  LPH-9,  and  the  4-page  follow-up 
report  on  the  solution  achieved  by  relocation  of  the  computer  Installation. 

4-2  EQUIPMENT  RMA  RESULTS 

4-2.1  FLEET  DATA  SUMARY.  Figure  1-4.2  presents  a brief  summary  of  the  basic  data 
obtained  from  fleet  data  collection.  The  total  operating  hours  and  total  calendar  hours 
are  used  to  compute  duty  cycle,  which  varies  from  a high  of  0.733  for  the  AN/SSR-1  SAT- 
COM  receiver  to  a low  of  0.219  for  the  AN/ART-50  VERDIN  transmitter.  The  number  of  failures 
and  the  number  of  repairs  during  the  data  collection  period  are  shown  as  well  as  the 
total  active  repair  and  the  total  equipment  down  time. 

4-2.2  DEPOT  DATA  SUMMARY.  Figure  1-4.3  summarizes  the  verification  factors  as  ob- 
tained from  analysis  of  depot  data.  The  usual  practice  is  to  count  only  those  failures 
that  are  verified  at  the  depot  as  being  relevant.  In  effect,  this  practice  attributes 
all  errors  to  the  fleet  while  considering  the  repair  depot  to  be  perfect.  Having  en- 
countered specific  Instances  of  less  than  perfect  test  and  analysis  at  repair  depots, 

FRAP  prefers  to  consider  the  fleet  and  the  depot  equally  likely  to  make  errors;  there- 
fore, one-half  of  the  non-verlfled  failures  are  counted  as  being  relevant. 

4-2.3  RELIABILITY  SUMMARY.  Figure  1-4.4  summarizes  the  operational  reliability  and 
equipment  reliability  for  each  of  the  equipments  In  the  FRAP  study.  Comparing  the  equip- 
ment MTBF  with  the  specification  MTBF  gives  the  unexpected  result  that,  with  the  excep- 
tion of  the  VERDIN  equipment,  all  systems  meet  the  specification.  The  MTBF  values 
stated  are  the  equivalent  MTBF  values  for  exponential  reliability  distribution.  Since 
the  exponential  reliability  distribution  assumption  Is  Implicit  In  the  equipment  speci- 
fication as  well  as  In  the  test  requirements  of  MIL-STD-781,  the  exponential  equivalent 
MTBF  Is  the  only  reasonable  value  that  can  be  compared  with  the  specification  MTBF. 

For  the  AN/WSC-3  and  for  the  AN/WRR-7,  however,  the  data  Indicates  the  reliability 
Is  distributed  according  to  a Wei  bull  function,  which  In  turn  Indicates  an  Increasing 
MTBF. 

4-2.4  MAINTAINABILITY  SUMMARY.  Figure  1-4.5  summarizes  the  maintainability  results. 
Comparison  of  mean-time- to-repalr  (MTTR)  with  the  specified  value  gives  the  result  that 
only  the  AN/URC-85  meets  the  specification.  Reasons  for  the  large  discrepancy  between 
reported  MTTR  and  specified  repair  time  are  discussed  In  the  Equipment  Reports.  This 
discrepancy  Is  rather  insignificant,  however,  except  in  the  case  of  the  AN/UYK-20  where 
an  Improvement  In  repair  time  would  have  a slightly  beneficial  affect  on  availability. 

The  mean  down  time  (MDT)  shown  Is  to  a very  large  extent  indicative  of  the  effectlven- 
ness  of  logistics  support  provided  to  the  fleet  and  Is  only  Influenced  In  a minor  way 
by  the  equipment  design  and  performance. 

4-2.5  AVAILABILITY  SUMMARY.  Figure  1-4.6  summarizes  operational  availability  results. 

FRAP  considers  operational  availability  to  be  extremely  Important  because  It  Is  the 
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final  result  of  reliability,  maintainability,  and  logistics  support.  The  proper  bal- 
ance of  these  three  elements  to  achieve  the  operational  availability  needed  In  the 
fleet,  at  a minimum  cost  level.  Is  a prime  goal  of  Systems  Effectiveness  Engineering. 
The  classical  calculation  of  operational  availability  Is  difficult  In  that  It 
must  be  calculated  by  simulation,  which  requires  recourse  to  a digital  computer  aid 
knowledge  of  both  the  reliability  and  the  down  time  probability  distributions.  FRAP 
performed  2000  calculations  for  each  equipment  to  obtain  the  estimates  shown  for  the 
population  mean  and  the  population  median.  Considerably  simpler  to  calculate  and 
more  meaningful  to  the  typical  user  Is  the  value  shown  as  "sample  observation".  This 
availability  Is  calculated  as  the  total  operating  hours  divided  by  the  sum  of  total 
operating  hours  and  the  total  down  time.  For  all  practical  purposes,  this  number  Is 
the  probability  that  the  equipment  will  work  when  the  user  needs  It. 
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# Figure  1-U.lb 


FIGURE  1-4.1  An  example  of  the  extra  effort  volunteered  by  the  fleet  is  this 
partial  reproduction  of  the  six  photographs  submitted  by  the  USS  SIMON  LAKE. 

(a)  shows  the  heat-blackened  case  of  the  voltage-regulator  integrated  circuit, 

(b)  shows  the  melting  of  solder  on  the  reverse  side  of  the  printed  circuit  board. 
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SECTION  V - RECOMMENDATIONS 
5-1  MAKE  FRAP  PERTINENT. 


5-1.1  The  FRAP  pilot  program  has  successfully  shown  that  It  Is  possible  to  obtain 
data  from  the  fleet  which  enables  determination  of  actual  RMA  values  that  can  be  com- 
pared to  the  stated  requirements  of  equipment  specifications.  Thus,  FRAP  closes  the 
control  loop  and  allows  the  NAVY  to  determine  the  effectiveness  of  Its  management  tools 
used  to  obtain  RMA  of  equipment  In  the  fleet.  Therefore,  FRAP  provides  the  prere- 
quisite knowledge  to  Improve  the  effectiveness  of  these  management  tools  - equipment 
specifications,  standards  and  handbooks,  test,  prediction  techniques,  and  other  pro- 
cedures. 

5-1.2  FRAP  enables  the  Navy  to  reduce  Life  Cycle  cost  through  cost  avoidance: 

(1)  Knowledge  of  actual  RMA  performance  enables  the  Navy  to  avoid  putting  addition- 
al money  Into  systems  that  are  "good". 

(2)  The  potential  payback  from  money  Invested  In  a particular  equipment  can  be 
determined  so  that  low-return  Investments  can  be  avoided. 

(3)  Trade-offs  between  rel 1 a blllty/malnta Inability  Improvement  and  Increased  log- 
istics support  can  be  evaluated  to  enable  cost  effective  allocation  of  limited  monies 
available. 

5-1.3  FRAP  motivates  contractors  to  make  effective  corrections  to  equipment  deficienc- 
ies since  the  Navy  Is  In  the  position  of  knowing  whether  or  not  the  specification  Is 
being  met. 

5-1.4  FRAP  motivates  contractors  to  conduct  failure  analyses  and  to  solve  their  com- 
ponent quality,  screening,  assembly,  or  quality  control  problems  before  the  Navy  becomes 
Involved. 

5-2  MOOIFY  MDS  INSTRUCTION  (OPNAV  4790.4).  FRAP  has  shown  that  only  a relatively 
ftw  modifications  to  the  present  3M  MDS  system  along  with  an  effective  depot  data  col- 
lection program  are  necessary.  The  following  changes  are  recommended: 

(1)  Report  Failure-Free  Time.  A periodic  report  of  elapsed-tlme-meter  reading  Is 
necessary  for  reliability  calculations. 

(2)  Report  Tlme-of -Failure.  Currently  reported  for  SEL  (Selected  Equipment  List) 
Items. 

(3)  Modify  the  4790/2K  Form.  For  example,  report  active  repair  time  In  tenths  of 
hours  Instead  of  whole  hours  since  most  specified  repair  times  are  less  than  one  hour. 

(4)  Select  Platforms  on  a Sampling  Basis.  Data  from  the  entire  fleet  population 
Is  not  required;  typically  10  to  205  of  the  population  Is  adequate. 

(5)  Limit  Time  Frame.  FRAP  requires  only  3 to  9 months  of  data  collection  to 
make  a determination  of  RMA  performance,  depending  upon  the  specific  equipment. 

(6)  Authorize  Direct  Fleet  Contact.  Direct  contact  with  the  men  aboard  the  ship 
Is  essential  to  FRAP. 


5-3  NAVELEXSYSCOM  ACTIONS.  The  following  NAVELEXSYSCOM  actions  are  recomaended. 

« (1)  Develop  Depot  Data  Collection  Requirements.  Short  term  depot  data  require- 

ments can  be  satisfied  by  ensuring  an  effective  CDRL  (Contract  Data  Requirements  List) 
and  DID  (Data  Item  Description)  are  Included  In  procurements. 

» (2)  Ensure  Elapsed  Time  Meters  (ETMs)  are  required  In  equipment  specifications 

and  that  the  ETMs  are  appropriately  located  so  as  to  monitor  the  correct  time  and  to 
be  accessible  for  reading. 

(3)  Ensure  that  ETM  locations  are  specified  for  3M  SEL  items. 

(4)  Ensure  the  effecltve  utilization  of  established  equipment  expertise  In  TSA 
selection. 

(5)  Work  toward  standardization  of  RMA  analysis  method. 
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HOURS  FAILURES 
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